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1  The  purpose  of  the  ,-Workshop  was  to  explore  the  current  “  state  of 
research  and  applications  in  Nonlinear  Time  Series  Analysis  and  to  explore 
the  common  ground  between  the  statistical  and  mathematical  dynamical 
approach  to  Nonlinear  Temporal  Systems.  Attention  was  "to-be* given  to  the 
practical  use  of  theoretical  developments  in  this  topic.  \  Local 
arrangements  were  undertaken  by  Messrs  P  R  Fisk  and  M  J  Prentice,  and  the 
academic  programme  was  organised  by  Professor  H  Tong. 


2  The  Workshop  was  held  at  the  University  of  Edinburgh  between  12th  and 
25th  July  1989,  the  last  two  days  of  which  were  an  "Open  Forum "^opeTT^to 
in tereStedpe  rsons  who  could  attend  at  their  own  expense. 


3  Dr  C  M  Bowden  of  the  Research  Directorate,  US  Army  Missile  Comnand, 
Redstone  Arsenal,  Alabama,  attended  the  workshop  under  the  terms  of  the 
contract.  It  is  expected  that  he  will  make  a  report  on  the  value  of  the 
workshop  to  him. 

4  Oral  and  written  comments  from  participants  indicate  that  the  workshop 
was  regarded  as  being  very  successful.  Many  promising  lines  of  research 
were  identified  and  a  fruitful  collaborative  dialogue  was  begun  between  the 
mathematical  dynamicists  involved  in  applications  of  chaos  theory  and 
statistical  specialists  in  non-linear  time  series.  Dr  McKenzie  of 
Strathclyde  University  is  currently  spending  *  -*o  months  with 
Professor  PAW  Lewis  at  the  Naval  Postgraduate  Scho<  ,  Monterey,  taking 
further  ideas  on  modelling  that  originated  at  the  workshop.  Similar 
collaborations  among  other  workshop  participants  are  planned. 

5  The  Open  Forum  complemented  the  closed  part  of  the  Workshop  by  giving 
an  opportunity  for  others  to  hear  about  topics  discussed  at  the  Workshop, 
and  to  make  their  own  contributions. 


6  Summary  of  Academic  Proceedings 


Lists  of  those  attending  the  Workshop,  and  programmes  for  both  the  Workshop 
and  the  Open  Forvjn,  are  attached.  Abstracts  of  the  talks  given  are  being 
prepared  and  will  be  circulated  to  participants.  Copies  of  these  abstracts 
will  be  made  available  on  request. 


The  Workshop  had  three  main  aspects 


( 1 j -Probabilistic  aspects^ 

(2)  Statistical  aspects  j  -hi  ,  • 

(3.)  Dynamical  systems  -i;  .  .•  >  '• ' 1 ; ^  1  rr  ‘  r  •  1  ’  /  * 


Within  these  three  a  number  of  applications  were  described.  These  included 


Econometrics  -  Granger,  Harvey,  Terasvirta 
Hydrology  -  Jones,  Gudmunsson,  Tong,  Ozaki 
Storms  -  Tawn 
Brain  -  Babloyantz 

Oceanography  -  Lewis  f. 


Ship  dynamics  -  Ozaki 
Control  systems  -  Lai 
Fish  population  -  Gudmunsson 
Ocean  Core  -  Tunnicl  iff e-Wi  Ison 
Football  matches  -  Harvey 


90  01  08  02a 


7  Probabilistic  Aspects 


A  number  of  issues  were  dealt  with  under  this  heading  all  concerned  with 
the  theoretical  properties  of  non-linear  time  series  models.  The  topics 
covered  can  be  summarised  as  follows: 

7.1  Ergodicity,  stationarity,  invertability 

Discussion  here  centred  around  the  problems  inherent  in  modeling 
non-linear  time  series.  Conditions  for  ergodicity  and  stationarity 
were  examined  for  a  simple  first-order  model  which  generalized  the 
first-order  autoregressive  linear  model.  The  concept  of  a  Lyapunov 
function  was  used  to  derive  the  conditions  under  which  the  stochastic 
series  is  ergodic.  Other  approaches  used  extensions  of  measures  of 
stability  in  a  simple  first-order  deterministic  model  to  determine  the 
properties  of  a  stochastically  disturbed  form  of  the  same  model.  A 
related  question  is  whether  the  stochastic  term  in  a  non-linear  model 
can  be  represented  as  a  function  of  the  present  and  past  members  of  the 
observable  series.  This  was  examined  for  the  general  bilinear  model 
and  for  threshold  autoregressive  and  moving  average/autoregressive 
models. 

7 . 2  Other  issues 

Particular  attention  was  given  to  non-linear  models  of  sequences  of 
dependent  random  variables  with  specified  marginals  and  covariance 
structure.  A  model  for  long-term  dependence  in  non-linear  time  series 
was  suggested  based  on  a  time  deformation  of  a  series  with  short  term 
dependence.  Various  approaches  to  M-step  non-linear  prediction  were 
considered  and  the  problems  of  time  reversability  and  directionality 
were  examined. 


8  Statistical  Aspects 


These  dealt  largely  with  exploratory  data  techniques  for  the  gaining  of  an 
understanding  of  a  non-linear  time  series,  with  formal  tests  for 
non-linearity,  with  methods  of  estimation  and  identification  of  non-linear 
time  series  models,  with  diagnostics  for  the  examination  of  assunptions  in 
non-linear  time  series  models  and  with  the  use  that  could  be  made  of  a 
variety  of  computer  software. 


9  Dynamical  Systems 


Interaction  between  the  four  dynamicists  and  the  statisticians  at  the 
workshop  proved  to  be  the  most  exciting  aspect  of  the  whole  meeting. 

Sparrow  and  Casdagli  introduced  the  statisticians  to  concepts  in  chaospor 

theory  such  as  Lyapunov  exponents,  correlation  dimension,  Kolmogorov  - -  -Z? 

entropy,  folding  axil  stretching,  sensitivity  to  initial  conditions,  2* 

attractors  aixi  strange  attractors,  embedding  dimensions  among  many  others.  q 

Farmer  appraised  the  role  of  chaos  in  statistics  and  the  relevance  of 13 _ _ 

statistics  in  chaos  studies.  Hie  statisticians  responded  by  suggesting  _ 

plausible  argunents  that  could  lead  to  a  possibly  dramatic  improvement  of 

the  formula  for  data  requirement  in  the  calculation  of  the  dimension  of  an - 

attractor.  A  nvmber  of  statistical  problems  were  identified,  solutions  of •®n/_ - - 

which  could  have  important  consequences  for  the  future  development  of  chaos  city  Oodw 
studies.  These  included:  the  estimation  of  the  embedding  dimension,  l  and/or 
sampling  properties  of  the  correlation  dimension,  the  definition  and  Mi*l 
estimation  of  the  Lyapunov  exponents  for  noisy  systems.  |  \  j 


10  Summary  of  achievements 


(1)  The  most  positive  contribution  was  the  interaction  between  the 
dynamicists  and  the  statisticians.  Problems  identified  as  tough  but 
important  by  one  group  were  identified  just  the  same  by  the  other. 
This  common  experience  has  encouraged  closer  co-operation  across 
subjects.  It  is  expected  that  statisticians  will  begin  to  make  a 
contribution  to  research  on  chaos  and  be  welcomed  by  the  dynamicists . 
The  workshop  will  be  remembered  as  playing  a  catalytic  role  in  this. 

(2)  In  the  past,  non-linear  time  series  analysis  has  been  confined  to 
specific  models.  The  workshop  has  broadened  the  horizon  and  shown  the 
need,  and  the  way,  to  focus  more  intensely  on  group  properties.  More 
attention  will  have  to  be  paid  to  the  general  properties  of  ergodicity, 
directionality,  long  memory,  self  similarity,  non  parametric  methods, 
model  discrimination,  non- regular  statistical  problems  and  extremes 
among  many  others. 

(3)  A  number  of  issues  were  identified  for  future  resolution  in  further 
research.  These  included:  parametric  vs  nonparametric  methods; 
univariate  vs  multivariate  models;  large  vs  small  data  sets;  single  vs 
multiple  realizations;  substantive  vs  empirical  modelling;  Bayesian  vs 
non-Bayes ian  approaches .  These  issues,  together  with  the  substantial 
collection  of  open  problems  identified  at  the  workshop,  will  provide  a 
source  of  research  projects  for  many  years  to  come. 

P  R  Fisk 

28  September  1989 


Research  Workshop  on 
Non-Linear  Time  Series  Analysis 


Dr  A  Bablyoantz 
Dr  M  Casdagli 
Professor  S  K  Chan 
Dr  W  K  Li 
Dr  Z  G  Chen 
Sir  David  Cox 
Dr  D  N  Davies 
Dr  D  Fanner 
Dr  R  J  Gerrard 
Professor  C  W  J  Granger 
Professor  D  Guegan 
Professor  A  Harvey 
Dr  D  A  Jones 
Professor  T  L  Lai 
Dr  J  A  Lane 
Professor  A  J  Lawrance 
Professor  PAW  Lewis 
Dr  G  Gudmundsson 
Professor  J  Liu 
Dr  E  McKenzie 
Dr  T  Ozaki 

Professor  J  D  Petruccelli 
Professor  P  M  Robinson 
Professor  M  Rosenblatt 
Professor  R  L  Smith 
Dr  C  Sparrow 
Dr  J  Tawn 
Dr  T  Terasvirta 
Professor  D  Tjdstheim 
Professor  H  Tong 
Professor  R  S  Tsay 
Dr  P  D  Tuan 

Dr  G  Tunnicliffe-Wilson 
Dr  M  West 


Participants 

ULB,  Bruxelles 

Queen  Mary  College,  London 

University  of  Chicago 

University  of  Hong  Kong 

Universitat  Heidelberg 

Nuffield  College,  Oxford 

Trent  Polytechnic 

Los  Alamos  National  Lab 

The  City  University,  London 

University  of  California 

University  Iferis  XIII 

London  School  of  Economics 

Institute  of  Hydrology 

Stanford  University 

University  College  Wales,  Aberystwyth 

Birmingham  University 

Naval  Postgraduate  School,  Monterey 

Central  Bank  of  Iceland 

University  of  British  Colombia 

University  of  Strathclyde 

Institute  of  Statistical  Mathematics, 

Tokyo 

WPI 

London  School  of  Economics 
University  of  California 
Univerisy  of  Surrey 
King’s  College,  Cambridge 
University  of  Sheffield 
ETLA,  Finland 
University  of  Bergen 
University  of  Kent 
Carnegie  Mellon  University 
Laboratoire  TIM3,  Fiance 
Lancaster  University 
Duke  University 


Workshop  on  Non-linear  Time  Series  Analysis  and  Applications 

Programme 


Tuesday  11  July  1989 


Introductory  meeting 


Wednesday  12  July 
9.00  -  10.30 

11.00  -  12.20 

1.50  -  2.40 

2.40  -  3.45 

4.10  -  4.45 

7.30  -  9.00 
Thursday  13  July 

8.50  -  10.10 

11.00  -  12.00 

1.50  -  2.55 

2.55  -  3.40 

4.10  -  4.45 

7.30  -  9.15 


H  Tong  (University 
of  Kent) 

C  W  J  Granger 
(University  of 
California,  La  Jolla) 

T  Terasvirta,  (Research 
Institute  of  the 
Finnish  Economy, 
Helskinki ) 

R  S  Tsay  (Carnegie- 
Mellon  University) 

J  D  Petruccelli 
(Worcester  Polytechnic 
Institute, 

Masachusetts ) 


Non-linear  time  series:  a 
dynamical  systems  approach 

Tests  of  nonlinearity 


Testing  linearity  of 
economic  time  series 
against  cyclical  asymmetry 


Non-linear  time  series 
analysis 

A  recap  of  testing 
non-linearity  in  time 
series 


Discussion  meeting  on  general  aspects  of  modelling 


M  Rosenblatt 
(University  of 
California,  La  Jolla) 

K  S  Chan  (University 
of  Chicago) 


A  J  Lawrence 
(University  of 
Birmingham) 

D  A  Jones  (Institute 
of  Hydrology) 

Dr  R  Cox  (Nuffield 
College,  Oxford) 


Old  unsolved  problems 


Stability  and  ergodicity: 
problems  motivated  from 
probability 

Directionality  and 
reversability  in  time 
series 

Towards  designer  forecasts 


A  oonmeitary  on  matters 
discuss ad 


Discussion  fleeting  on  mxnerioal  calculations  of 
marginal  distributions  and  of  particular  bilinear 
models  via  Chapamui-Kolnogorov  relation. 


Friday  14  July 


8.55  - 

10.05  - 

11.30  - 

1.50  - 

2.50  - 

4.10  - 

Monday  17 
9.00  - 

11.00  - 

1.30 

2.45 

4.00 

4.50 


10.05 

PAW  Lewis  (Naval 
Postgraduate  School, 
Monterey) 

An  exploratory  analysis  of 
daily  sea  surface 
temperatures  and  related 
time  series  along  the 
California  coast 

11.05 

P  M  Robinson  (London 
School  of  Economics) 

Non-Gauss ian  (semi- 
parametric)  econometric 
models 

12.30 

D  Tjtfstheim  (University 
of  Bergen) 

Non-parametric  estimation 
and  identification 

2.50 

C  Sparrow  (King’s 
College,  Cambridge) 

Dynamical  systems  and 
chaos 

3.40 

M  Casdagli  (Queen 

Mary  College,  London) 

Chaos  and  time  series 
analysis 

5.25 

T  Ozaki  (Institute  of 
Statistical  Mathematics, 
Tokyo) 

Continuous  time  series 
modelling 

JutZ 

10.35 

T  L  Lai  (Stanford 
University) 

Adaptive  prediction  and 
control  in  non-linear  time 
series  models 

12.15 

R  L  Smith  (University 
of  Surrey) 

Long-range  dependence  and 
fractional  Brownian  models 

2.45 

E  McKenzie  (Strathclyde 
University) 

Discrete  variate  time 
series  models 

3.40 

J  Tawn  (University  of 
Sheffield) 

The  role  of  multivariate 
extremes  in  time  series 

4.50 

Z  G  Chen  (University 
of  Heidelberg) 

Towards  new  sketches  of 
hypothesis  testing  based 
on  a.s.  convergence 

5.15 

W  K  Li  (University  of 
Hong  Kong) 

Discriminating  non-linear 
time  series  models  using 
a  bootstrapped  Cox  test 

Tuesday  18  July 


9.00  -  10.30 


11.00  -  12.40 

2.00  -  2.50 

2.50  -  3.10 

3.35  -  4.15 

4.15  -  5.10 

7.30  -  9.45 
Wednesday  19  July 
9.00  -  9.50 

9.50  -  10.10 

10.30  -  11.30 

11.30  -  12.15 

1.50  -  3.05 

3.40  -  4.30 


4.30  -  5.20 


Discussion  on  open  problems:  (Chair:  D  R  Cox) 

classification  problems 
sample  path  properties 
long-range  memory 
reversibility 
special  processes 


D  Fanner  (Los  Alamos 
National  Laboratory) 

R  J  Gerrard  (City 
University) 

G  Gudmundsson 
(Central  Bank  of 
Iceland) 

D  Guegan  (University 
of  Paris) 

D  N  Davies  (Trent 
Polytechnic) 


Introduction  to  chaos 

Noisy  chaos:  a  Markovian 
approach 

Threshold  models  of 
Icelandic  rivers 


Invertibility  of  bilinear 
time  series  models 

The  application  of  dynamic 
linear  modelling  and 
associated  software  to 
problems  of  non  linear 
time  series 


Discussion  meeting  on  Chaos 


D  R  Cox  (Nuffield 
College,  Oxford) 

P  D  Tuan  (Laboratoire 
TIM3,  France ) 


K  S  Chan  (University 
of  Chicago) 

A  Harvey  (London 
School  of  Economics) 


A  Harvey  (London 
School  of  Economics) 


J  A  Lane  (University 
College,  Wales, 
Aberystwyth) 

0  Tunnicliff e-Wilson 
(Lancaster  University) 


Long-range  dependence  and 
non-linear  time  series 

Strong  consistency  of  the 
least-squares  estimator 
for  a  simple 
non-stationary  model 

Estimation  of  threshold 
models 

Computer  demonstration  of 
STAMP  package  (Structural 
Time  Series  Analyzer, 
Modeller  and  Predictor) 

Time  series  models  for 
count  or  qualitative 
observations 

Approximations  for 
non-linear  autoregressive 
forecasting 

Gens  tat  5  -  an  application 
to  a  time  scale  problem 


9.00  -  10.40 


Discussion  of  open  problems  posed  by  Tsay  and 
Lawrence 


11.00  -  12.15 

1.50  -  2.35 

2.35  -  3.35 


C  W  J  Granger  A  survey  of  the  interface 

(University  of  between  econometrics  and 

California,  La  Jolla)  non-linear  time  series 

G  Gudraundsson  (Central  Time  series  application 
Bank  of  Iceland)  to  fish  catch  data 

C  Sparrow  (King's  Dimension  calculations 

College,  Cambridge)  with  reference  to  the 

problem  of  data 
requirements 

A  Babloyantz  (Free  Chaotic  time  series  of 

University  of  Brussels)  electrophysiology 

Discussion  meeting  on  Chaos 


E  McKenzie  (Strathclyde  Mini ficat ion  process 
University) 

Z  G  Chen  (University  Reversibility  of  multiple 

of  Heidelberg)  time  series 

J  Liu  (University  of  Some  results  in  bilinear 
British  Columbia)  and  threshold  models 

Discussion  of  hydrological  control  problem; 
modelling  a  reservoir  on  the  river  Thames 

Address  by  representatives  of  the  SERC  Mathematics 
Committee  to  British  participants 

Discussion  of  open  problems  chaired  by  R  L  Smith 


Monday  24  July 


0i«*  FORUM 
Programme 


9.00  - 

11.00  - 

2.15  - 

2.45  - 

3.45  - 

Tuesday  25 
9.00  - 

11.00  - 

2.15  - 


10.30 

H  Tong  (University 
of  Kent) 

Recent  developments  in 
non-linear  time  series 

12.30 

R  Tsay  (Camegie- 
Mellon  University) 

Some  topics  in  the 
statistical  aspects  of 
non-linear  time  series 

2.45 

C  Chatfield  (University 
of  Bath) 

Multiplicative 
Holt-Winters  forecasting: 
non-linear  aspects 

3.15 

G  J  Janacek  and 

A  L  Swift  (University 
of  East  Anglia) 

Experience  with  a  class 
of  non-normal  time  series 

4.15 

S  Mittnik  (State 
University  of  New 

York) 

Estimation  of  general 
non-linear  dynamic  time 
series 

July 

10.30 

A  Babloyantz  (Free 
University  of  Brussels) 

Chaotic  time  series 

12.30 

R  Gerrard  (City 
University) 

Some  topics  in  the 
probabilistic  aspects  of 
non-linear  time  analysis 

3.30 

Demonstrations  of  computer  software 

